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(54) Filtering method and apparatus for reducing block artifacts or ringing noise 



(57) A filtering method and apparatus for removing 
blocking artifacts and ringing noise. The filtering method 
includes transforming video data In a block-by-block ba- 
sis, and detecting the presence of an edge region in the 



video data by checking the distribution of values ob- 
tained by the transformation. Accordingly, it is possible 
to completely remove blocking artifacts and/or ringing 
noise by more effectively detecting the presence of an 
edge region In video data. 
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Description 

[0001] The present invention relates to removing blocking a rti facts and ringing noise, and more particularly, to a 
filtering method and apparatus for removing blocking artifacts and ringing noise caused when processing an image 

5 frame on a block-by-block basis. 

[0002] In general, video data is encoded by processing Image frames in block units. In particular, according to video 
data encoding standards such as moving picture experts group (MPEG) and H.263, video data Is encoded by performing 
a discrete cosine transform (DCT) and quantization on image frames in block units. However, encoding image frames 
in block units may result in blocking artifacts and ringing noise. Blocking artifacts make an edge region, which was not 

10 contained In the original frame, occur in a reproduced image frame, thereby causing discontinuity between adjacent 
pixels of the edge region in the reproduced image frame. Also, when ringing noise occurs in an Image frame, a borderline 
of an object In the image frame is not smoothly depicted, e.g., the borderline may be irregular. The higher a compression 
rate of the reproduced image frame, the more serious the blocking artifacts and the ringing noise. 
[0003] To filter the blocking artifacts and the ringing noise, it is important to first find an exact region of the image 

15 frame in which the blocking artifacts and ringing noise occur. Otherwise, an edge region present In the original image 
frame may be mistakenly regarded as being generated due to the blocking artifacts and removed, thereby deteriorating 
the quality of the image. 

[0004] In general, detection of an edge region of a pixel block reproduced due to the blocking artifacts and/or ringing 
noise is required to accomplish a conventional filtering method for removing blocking artifacts and/or ringing noise. For 

20 Instance, in a reproduced Image frame consisting of a plurality of 8x6 or 4x4 pixel blocks, the distribution of pixel 
values, such as brightness, luminance, and color of pixels present on boundaries between the 8x8 or 4x4 pixel blocks 
are measured and the measured values are compared with a predetermined critical value. The critical value is exper- 
imentally obtained by measuring the distribution of the above pixel values, such as brightness, luminance, and color 
of pixels, finding a relationship between the distributions of the above pixel values, and determining whether the edge 

25 region is present or not in an image frame. 

[0005] To measure the distribution of pixel values, pixel values in a boundary region between adjacent blocks must 
be checked in vertical or horizontal direction. However, in fact, the checking of every pixel value in the boundary region 
is almost impossible because of a large amount of calculation and complexity. In particular, since pixel values are 
stored in a memory device in the vertical direction in chronological order, continuous access to the memory device is 

30 required to calculate pixel values in the vertical direction. However, continuous access to a memory device is, at least 
for the time being, highly impractical. 

[0006] An aim of the present invention is to provide a method and apparatus for efficiently removing blocking artifacts 
and/or ringing noise. A preferred aim is to provide such a method and apparatus which reduces processing cost and/ 
or reduces memory access. 

35 [0007] According to the present invention there is provided an apparatus and method as set forth in the appended 
claims. Preferred features of the invention will be apparent from the dependent claims, and the description which 
follows. 

[0008] In general terms, the present invention provides a filtering method and apparatus for effectively detecting an 
edge region present in a pixel block. 
<0 [0009] The present invention also provides a filtering method and apparatus for effectively detecting an edge region 
present in a pixel block with a small amount of calculation. 

[0010] In one aspect of the present invention, there is provided a filtering method for removing blocking artifacts, 
including (a) transforming video data in a block-by-block basis; and (b) detecting the presence of an edge region in 
the video data by checking the distribution of values obtained by the transformation. 
« [0011] In another aspect of the present invention, there is provided a filtering method forremoving blocking artifacts, 
including (a) transforming and quantizing video data in a block-by-block basis; (b) creating filter information based on 
the distribution of values obtained by the transformation and quantization; and (c) filtering the video data based on the 
filter information. 

[0012] Preferably, (a) includes (a1) performing DCT the video data in a block-by-block basis to obtain DCT coeffi- 
so cients; and (a2) quantizing the DCT coefficients. More preferably, (a) includes performing DCT and quantization on a 
4X4 pixel block to obtain a 4x4 quantized DCT block. 

[0013] Preferably, (b) includes creating filter information indicating the degree of the occurrence of blocking artifacts 
and/or ringing noise based on the quantized DCT coefficients. More preferably, (b) comprises (b1 ) creating filter infor- 
mation by checking the values of pixels, except for a DC component, at the uppermost row of the quantized DCT block, 
55 where the filter information indicates whether an edge region is present in a vertical direction of the original pixel block. 
[0014] Preferably, (b) also comprises (b-2) creating filter information by checking the values of pixels, except for the 
DC component, at the leftmost column of the quantized DCT block, where the filter Information indicates whether an 
edge region is present in a horizontal direction of the original pixel block. Otherwise, (b) may comprise (b3) creating 
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filter information by checking the values of pixels not at the uppermost row and leftmost column of the quantized DCT 
block, where the filter Information indicates whether an edge region is present In a diagonal direction of the original 
pixel block. 

[0015] Preferably, (b) comprises setting a vertical blocking flag (VBF) and a horizontal blocking flag (HBF) to 1 as 
6 the filter information when only the pixel A has a value other than 0. Preferably, (c) comprises deblocking filtering more 
strongly in the vertical and horizontal directions of the pixel block if the HBF and VBF are set to 1 . 
[0016] Preferably, (b) comprises setting the VBF to 1 as the filter information when only the pixels A and B have 
values other than 0, and (c) comprises deblocking filtering more strongly in the vertical direction of the pixel block when 
the VBF is set to 1. 

10 [0017] Preferably, (b) comprises setting the HBF to 1 as the filter Information when only the pixels A and C have 
values other than 0, and (c) comprises deblocking filtering more strongly in the horizontal direction of the pixel block 
when the HBF is set to 1 . 

[0018] Preferably, a ringing flag (RF) is set to 1 when the pixels A, B, and C have values other than 0, and (c) 
comprises deringing filtering more strongly when the RF is set to 1, 
15 [0019] According to still another aspect of the present invention, there is provided a filtering method for removing 
blocking artifacts, including (a) transforming and quantizing a block consisting of video data in pixel units so as to obtain 
quantized values, checking the obtained quantized values, and creating filter information when the checking result is 
for filter information; and (b) performing filtering based on the created filter information. 

[0020] Preferably, (a) comprises (a1) performing DCT and quantization on one of pixels, except for a pixel corre- 
20 spending to a DC component, at the uppermost and leftmost columns of the block to obtain a quantized DCT coefficient; 
and (a2) checking the quantized DCT coefficient, creating filter Information based on the checking result when the 
quantized DCT coefficient is a value other than 0, and terminating performing DCT and quantization on the pixels at 
the uppermost row and leftmost column. 

[0021] (a) comprises (a3) checking the quantized DCT coefficient, and performing DCT and quantization on one of 
25 pixels, except for the pixel corresponding to the DC component, at the uppermost row and leftmost column when the 
quantized DCT coefficient is 0; (a4) repeatedly performing (a2) and (a3) on the remaining pixels, except for the pixel 
corresponding to the DC component and the one pixel, at the uppermost and leftmost columns so as to obtain quantized 
DCT coefficients; and {a5) creating filter information when the quantized DCT coefficients for all of the pixels at the 
uppermost row and leftmost column are 0. 
30 [0022] According to still another aspect of the present invention, there is provided an encoder for encoding video 
data, comprising a loop filter wherein the loop filter comprises; a filter information producing unit which creates filter 
information based on the distribution of values obtained by transforming and quantizing a pixel block; a filter charac- 
teristics decision unit which determines filter characteristics based on the created filter information; and a deblocking 
filter which deblocking filters based on the determined filter characteristics. 
35 [0023] Preferably, the loop filter further comprises a loop transforming unit which transforms pixel values for inter 
frame in a block-by-block basis, and a loop quantizing unit which quantizes values transformed by the loop transforming 
unit. 

[0024] For a bettBr understanding of the invention, and to show how embodiments of the same may be carried into 
effect, reference will now be made, by way of example, to the accompanying diagrammatic drawings in which: 

40 

Figure 1 is a block diagram of an encoding apparatus according to a preferred embodiment of the present invention; 

Figure 2 is a block diagram of a loop filter according to a first embodiment of the present invention; 

45 Figures3 and 4 are diagrams illustrating a methodfor producing filter information using a filter information producing 

unit according to a first embodiment of the present invention; 

Figure 5 is a diagram illustrating filter information produced according to a modified one of the first embodiment 
of the present invention; 

so 

Figure 6 is a flow chart illustrating a filtering method according to a first embodiment of the present invention; 

Figure 7 is a flow chart illustrating another filtering method according to the first embodiment of the present inven- 
tion; 

55 

Figure 8 is a block diagram of a loop filter according to a second embodiment of the present invention; 

Figure 9 is a diagram illustrating a method for obtaining filter information extraction data using a filter information 
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producing unit, and a method far producing filter information based on the obtained filter information extraction 
data, according to a second embodiment of the present Invention; and 

Figure 10 is a flow chart illustrating a filtering method according to a second embodiment of the present invention. 

5 

[0025] For a better understanding of the present invention, the concept of encoding video data will be briefly described 
before describing preferred embodiments of the Invention with reference to the accompanying drawings. 
[0026] In general, video data consists of a plurality of image frames, Image frames are encoded into an intra frame 
and an inter frame and then transmitted. The intra frame is encoded with no reference to other images and can be 
10 independently decoded. Meanwhile, the inter frame is encoded based on a previous or next image, that is, a difference 
between the inter frame and the frame of a previous or next frame, and therefore, decoding of the inter frame requires 
the previous or next frame. Each Image frame consists of a plurality of macro blocks, and each macro block contains 
a plurality of pixel blocks. 

[0027] In a filtering method and an encoding apparatus for performing the method according to a preferred embod- 
15 iment of the present invention, an edge region is detected by transforming a macro block or a pixel block and checking 

the distribution of obtained transform values and/or values obtained by quantizing the transform values. A preferred 

example filtering method and an encoding apparatus for performing the method will now be described. 

[0028] Figure 1 is a block diagram of an encoding apparatus according to a preferred embodiment of the present 

invention. Referring to Figure 1, the encoding apparatus includes a motion estimator 1, a transformer 2, a quantizer 
20 3, an inverse quantizer^ an Inverse transformer 5, a motion compensator 6, and a loop filter 7. The encoding apparatus 

further includes a controller (not shown), a first switch 10, a second switch 20, and a third switch 30, all switches being 

controlled by the controller. 

[0029] When video data is input to the controller, the controller controls the first switch 10 such that an intra frame 
and an inter frame are input directly to the transformer 2 and the motion estimator 1 , respectively. The motion estimator 

25 1 compares a pixel value with a previous pixel value in pixel block units and outputs a difference, i.e., motion vector, 
between the pixel value and the previous pixel value, to the transformer 2. The transformer 2 changes descriptive 
manner of data, i.e. .transforms, for pixel values present in an imageframeincaseof the intra frame, and the difference, 
i.e., motion vector, in case of the inter frame. In this embodiment of the present invention, discrete cosine transform 
(DCT) is performed to transform image frames but any applicable method such as a discrete wavelet transform (DWT) 

30 may be used instead of the DCT. The quantizer 3 quantizes the transformed values, I.e., DCT coefficients, according 
to predetermined quantization step. The quantization step may be determined adaptively to the respective block unit. 
However, the larger the size of the quantization step, the more noise due to quantization of values increases. Values, 
which are obtained by performing the OCT and quantization on an image frame, are coded using variable-length coding 
(VLC), for example, and transmitted to a receiving end. 

35 [0030] Meanwhile, the values, which are obtained by the DCT and quantization, are input to the inverse quantizer 4 
or the loop filter 7. Also, the controller controls the second switch 20 to input intra frames to the loop filter 7 and inter 
frames only to the inverse quantizer 4. More specifically, in case of intra frames, values output from the quantizer 3 
are required to detect an edge region, that is, values obtained by performing the DCT and quantization on pixels in 
block units. Therefore, the values can be input directly to the loop filter 7 without being additionally processed. In case 

40 of interframes, values outpulfrom the quantizer 3 are obtained by performing the DCT and quantization on differences 
(motion vectors) between the inter frames and their previous frames. Thus, the values are input to the inverse quantizer 

4 to perform the DCT and quantization on pixels on a block-by-block basis, which is a process of restoring pixel values 
in block units. 

[0031] The inverse quantizer 4 inversely quantizes the given pixel values according to a predetermined quantization 
45 step, and the inverse transformer 5 inversely transforms the inversely quantized values. More specifically, in this em- 
bodiment, the inverse transformer 5 performs inverse discrete cosine transform (IDCT) on the inversely quantized 
values. However, in case that the transformer 2 adopts a transform method other than the DCT, the inverse transformer 

5 performs the inverse transform based on the transform method, instead of the IDCT. For instance, if the transformer 
2 is set to perform discrete wavelet transform (DWT) on pixel values, the inverse transformer 5 performs inverse DWT 

so (IDWT) thereon. Intra frames output from the inverse transformer 5 are pixel values to be filtered, i.e., pixel values of 
a current image frame, and thus are input to the loop filter 7. Interframes need to be compensated for their motion to 
obtain pixel values for the current image frame, and thus are input to the motion compensator 6. Next, the controller 
controls the third switch 30 to input the intra frames output from the inverse transformer 5 to the loop filter 7 and input 
the inter frames output from the inverse transformer 5 to the motion compensator 6. Then, the motion compensator 6 

55 adds differences between the inter frames and a previous image frame to the previous image frame in block units, 
restores the current image frame, and outputs the result to the loop filter 7. 

[0032] The loop filter 7 filters Image frames. According to a first embodiment of the present invention, the loop filter 
7 checks the distribution of values obtained by performing DCT and quantization thereon to determine whether an 



4 



EP 1 333 6B1 A2 

edge region Is present in en image frame, and filters the image frame according to the checking result. According to 
a second embodiment of the present invention, the loop filter 7 checks values obtained by performing OCT and quan- 
tization on pixel values at the leftmost row and uppermost columns, respectively, so as to determines whether an edge 
region is present in an image frame. Next, the loop filter filters the image frame according to the checking result. A 
5 detailed description of the operations of the loop fitter 7 will be described later. 

[0033] Figure 2 is a block diagram of the loop filter 7 according to the first embodiment of the present invention. 
Referring to Figure 2, the loop filter 7 Includes a loop transforming unit 71 , a loop quantizing unit 72, a filter information 
producing unit 73, a filter characteristics decision unit 74, a deblocking filter 75, and a deringing filter 76. 
[0034] There are two types of data input to the loop filter 7: (i) object data® to be filtered; and (ii) filter information 
to extraction data © and © to be used to produce filter information. The object data ® refers to pixel values of image 
frames in block units. The object data® of an intra frame is transmitted to the loop filter 7 via the third switch 30, and 
that of an inter frame is input from the motion compensator 6 to the loop filter 7. In the first embodiment, the filter 
information extraction data® and© refer to values obtained by performing OCT and quantization on pixel values of 
a certain block. In case of the filter information extraction data® of an intra frame refers to values obtained by por- 
ts forming DCT and quantization on pixel values on a certain block and is transmitted directly to the loop filter 7 via the 
second switch 20 so as to create filter information without an additional calculation process. However, the filter infor- 
mation extraction data © of an inter frame is input to the loop filter 7 from the motion compensator 6 and thus must 
be transformed and quantized within the loop filter 7. For this reason, values input via the second switch 20, i.e., the 
filter information extraction data© of an intra frame, are input to the filter information producing unit 73, and the values 
20 Input from the motion compensator 6, i.e., the filter Information extraction data® of an Inter frame, are input to the 
loop transforming unit 71. 

[0035] The loop transforming unit 71 and the loop quantizing unit 72 transforms and quantizes pixel values in a block- 
by-block basis for an inter frame, respectively. The loop transforming unit 71 and the loop quantizing unit 72 have the 
same functions, i.e., transformation and quantization, as the transformer 2 and the quantizer 3 shown in Figure 1. 

25 However, the transformation and quantization of the loop transforming unit 71 and the loop quantizing unit 72 do not 
need the same precision as the transformer 2 and the quantizer 3. This is because values produced by the loop trans- 
forming unit 71 and the bop quantizing unit 72 are used to only detect the occurrence of an edge region, and thus may 
have lower precision than those obtained by the transformer 2 and the quantizer 3 to encode video data. Accordingly, 
the loop transforming unit 71 and the loop quantizing unit 72 may lower precision in DCT and quantization by using 

30 Integral operation Instead of decimal operation, increasing the size of quantization step, or performing a fast-mode 
DCT, thereby reducing the amount of calculation. For instance, a simplified quantization algorithm performed by the 
loop quantizing unit 72 is as follows: 

35 LEVEL = (KxA{QP) + fx 2 20 )/2 20 , 

wherein LEVEL denotes a quantized value, K denotes a quantized pixel value on which DCT is performed, A 
(QP) denotes a constant from a mapping table, and f is a constant determined depending on a target compression 
efficiency. The quantized value is set to 1 if K< (2 20 -fx2 20 )fA(QP), and is set to another predetermined value otherwise. 

<o [0036] The filtering information producing unit 73 creates filter information with values obtained by performing DCT 
and quantization on pixel values in a block-by-block basis. A detailed description of the operation of the filtering infor- 
mation producing unit 73 will be later described. The filter characteristics decision unit 74 determines and outputs filter 
characteristics based on the filter information. The deblocking filter 75 and the deranging filter 76 perform filtering on 
video data according to the determined filter characteristics. 

45 [0037] Figures 3 and 4 are diagrams illustrating a method for creating filter information using the filter information 
producing unit 3 of Figure 1, according to a first embodiment of the present invention. Referring to Figure 3, DCT and 
quantization are performed a 4X4 pixel block, which is a basic unit in the first embodiment, to obtain a 4X4 quantized 
DCT block (hereinafter, 'DCT block'). In the DCT block, a denotes a DC component, b denotes pixels, except for the 
DC component a, at the uppermost row of the DCT block that indicate whether an edge region is present in the vertical 

so direction of the DCT block, c denotes pixels, except for the DC component a, at the leftmost column of the DCT block 
that indicate whether an edge region is present in the horizontal direction of the DCT block, and d denotes pixels, 
except for the values a through c at the leftmost and uppermost rows of the DCT block, which indicate the occurrence 
of ringing noise in a diagonal direction of the DCT block. 

[0038] In conclusion, filter information is created using the values of pixels A through C, according to a preferred 
55 embodiment of the present invention, shown in Figure 4. The presence or degree of blocking artifacts is determined 
by checking the values of the pixels A, B, and C and filter information is created according to the checking result, as 
follows: 
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(1) In case where only the pixel A has a value other than 0: 

That is, if the pixels B and C are set to 0, all pixels of a pixel block, which is to be reproduced at a receiving 
site, have the same values. In this case, there is very little probability that an edge region is present in the 
s horizontal and vertical directions of the original pixel block. Therefore, if an edge region is present in a repro- 

duced pixel block, it is regarded as being due to blocking artifacts, and thus, a horizontal vertical blocking flag 
(HBF) and a vertical blocking flag (VBF) are set to 1 as filter information. 

(2) In case where only the pixels A and B have a value other than 0: 

10 

In this case, pixel in the vertical direction of a pixel block reproduced at a receiving site, have the same value 
within a predetermined range. This means there is a probability that an edge region is present in the horizontal 
direction of the original pixel block but there is very little probability that an edge region is present in the vertical 
direction of the original pixel block. That is, an edge region is present only in the vertical direction of the 
75 reproduced pixel block, which is considered as being due to the blacking artifacts. Therefore, the VBF is set 

to 1 as filter information. 

(3) in case where only the pixels A and C have a value other than 0: 

20 In this case, pixels in the horizontal direction of a pixel block reproduced at a receiving site, have the same 

values within a predetermined range. This means there is a probability that an edge region is present in the 
vertical direction of the original pixel block but there is very little possibility that an edge region is present in 
the horizontal direction thereof. Therefore, if an edge region is present in the horizontal direction of the repro- 
duced pixel block, it is regarded as being due to the blocking artifacts. In this case, the HBF is set to 1 as filter 

25 information. 

(4) In case where values, except for the pixels A, B, and C, have a value other than 0: 

If pixels at the rows and columns, except for the columns to which the pixels A and B belong, and the rows to 
30 which the pixels A and C belong, have a value other than 0, a ringing flag RF Is set to 1 as filter information. 

This means a ringing noise occurs in a reproduced pixel block. 

[003S] When the HBF and/or the VBF, and the RF are transmitted to the filter characteristics decision unit 74, the 
filter characteristics decision unit 74 determines filter characteristics based on these flags. In other words, if the HBF 

35 js determined, the deblocking filter 75 is set to perform filtering more strongly in the horizontal direction of a pixel block. 
If the VBF is determined, the deblocking filter 75 is set to perform filtering more strongly in the vertical direction of the 
pixel block. If the RF is set, the deranging filter 76 is set to more strongly perform filtering the pixel block. Accordingly, 
it is possible to perform adaptive filtering on video data according to the degree of blocking artifacts and/or ringing noise. 
[0040] In the first embodiment, filter information is created using the values of the pixels A, B, and C to remove 

*> blocking artifacts. Alternatively, it is possible to create filter information while skipping checking at least one of the 
values of the pixels at the uppermost and leftmost columns according to the specifications, such precision and rapidity, 
of an application. 

[0041] Figure 5 is a diagram illustrating filter information produced according to a modified example of the first em- 
bodiment of the present invention. Here, a loop filter 7 of Figure 2 is used. However, the modified example of the first 
45 embodiment is different from the first embodiment in that discrete wavelet transform (DWT), instead of DCT, is per- 
formed on image frames. 

[0042] Referring to Figure 5, DWT and quantization are performed on a 4X4 pixel block to obtain four 2x2 quantized 
DWT blocks e through h. The block e is obtained by passing the 4X4 DCT block, of Figure 4, through a lowpass filter 
and corresponds to the DC component, i.e., pixel A, of the 4x4 quantized DCT block. The block /corresponds to the 

so pixel B of the 4x4 quantized DCT block, i.e., it indicates whether an edge region is present in a horizontal direction of 
the original pixel block. The block g corresponds to the pixel C of the 4x4 quantized DCT block, i.e., it indicates whether 
an edge region Is present in a vertical direction of the original pixel block. The block h corresponds to the other pixels, 
not on the uppermost and leftmost columns of the block to which the pixels A and B, and pixels A and C belong, of the 
4x4 quantized DCT block. The block h indicates whether ringing noise occurs in the original pixel block. 

55 [0043] In the first embodiment, filter information is created using the values of the pixels A, B, and C. Similarly, in 
the modified example of the first embodiment, filter information indicating the occurrence of blocking artifacts and/or 
ringing noise Is also created using the blocks e, f, g, and h. 

[0044] A filtering method according to the first embodiment of the present invention will now be described. 
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[0045] Figure 6 is a flow chart illustrating a filtering method according to a first embodiment of the present invention. 
Referring to Figure 6, an encoder performs DCT on input video data In a block-by-block basis in step 601 to obtain 
DCT coefficients. Next, the DCT coefficients are quantized according to a predetermined quantization step to obtain 
a quantized DCTblock in step 602. After step 602. the encoder checks the distribution of values of pixels of the quantized 
5 OCT block in step 603, and creates filter information based on the checking result in step 604. With the filter information, 
it is possible to detect the degree of blacking artifacts and/or ringing noise. After step 604, the encoder determines 
filter characteristics based on the created filter information and performs adaptive filtering on the input video data in 
step 605. 

[0046] Figure 7 is a flow chart illustrating another filtering method according to the first embodiment of the present 
10 invention. Referring to Figures 2 and 7, in step 701 , the filter information producing unit 73 checks the distribution of 
values of pixels of a quantized DCT block, and sets a horizontal blocking flag HBF, a vertical blocking flag VBF, or a 
ringing flag RF to 1 or 0. If the HBF is set to 1 In step 702, the filter characteristics decision unit 74 determines filter 
characteristics such that the deblocking filter 75 performs filtering more strongly in the vertical direction of the DCT 
block, in step 703. If the VBF is set to 1 in step 704, the filter characteristics decision unit 74 determines and outputs 
15 filter characteristics such that the deblocking filter 75 performs filtering more strongly in the horizontal direction of the 
DCT block, In step 705. If the HBF and the VBF are set to 1 in step 706, the filter characteristics decision unit 74 
determines filter characteristics such that the deblocking filter 75 performs filtering more strongly in the vertical and 
horizontal directions of the DCT block, in step 707. If the RF is set to 1 in step 706, the filter characteristics decision 
unit 74 determines filter characteristics such that the deranging filter 76 performs filtering more strongly on the DCT 
20 block, In step 709. Thereafter, the deblocking filter 75 and the deranging filter 76 perform adaptive filtering on input 
video data according to the set filter characteristics, in step 710. 

[0047] Deblocking filtering is performed in a block-by-block basis, but video data is in fact input to the encoder together 
with pixel values at border regions of blocks adjacent to a current block as well as the current block. The input pixel 
values are filtered by the deblocking filter 75 and outputs as changed values. For instance, adjacent values 3 through 

25 6 are changed when pixel values 1 through 4 of the current block and pixel values 5 through 8 of the adjacent block 
are more strongly filtered by the deblocking filter 75, and only the values 4 and 5 are changed otherwise. Accordingly, 
a flag of an adjacent block is compared with that of a current block to adjust the characteristics value of the deblocking 
Filter 75. That is, the filter characteristics value of the deblocking filter 75 is set to a strong value if the flag of the adjacent 
block is the same as that of the current block and set to a weak value otherwise. 

30 [0048] Alternatively, the filter information producing unit 73 may compare the flags VBF, HBF, and RF of the adjacent 
blocks with the flags VBF, HBF, and RF of the current block, and create filter information based on the comparison 
result As a result, trie created filter information can be more accurately expressed than the filter information created 
using flags of the current block, and thus, filter characteristics values can be more precisely determined. 
[0049] Figure 8 is a block diagram of the loop filter 2 according the second embodiment of the present invention. 

35 Referring to Figure 8, the loop filter 7 includes a loop transforming unit 81 , a bop quantizing unit 82, a filter information 
producing unit 63, a filter characteristics decision unit 74, a deblocking filter 75, and a deranging filter 76. 
[0050] There are two types of data input to the loop filter 7: (i) object data © to be filtered; and (ii) filter information 
extraction data® and® to be used to produce filter information. The object data® refers to pixel values of image 
frames in block units. The object data© of an intra frame is transmitted to the loop filter 7 via the third switch 30, and 

40 that of an inter frame is input from the motion compensator 6 to the loop filter 7. As in the second embodiment, the 
filter information extraction data (2) and £D refer to values obtained by performing DCT and quantization on pixel 
values of a certain block. In case of the filter Information extraction data© of an intra frame refers to values obtained 
by performing DCT and quantization on pixel values on a certain block and is transmitted directly to the loop filter 7 
via the second switch 20 so as to create filter information without an additional calculation process. However, the filter 

45 information extraction data © of an inter frame is input to the loop filter 7 from the motion compensator 6 and thus 
must be transformed and quantized within the loop filter 7. For this reason, values input via the second switch 20, i.e., 
the filter information extraction data® of an intra frame, are input to the filter Information producing unit 83, and the 
values input from the motion compensator 6, i.e., the filter information extraction data® of an inter frame, are input 
to the loop transforming unit 71 . 

so [0051] The loop transforming unit 81 performs DCT or DWT on first and second pixels at the leftmost row and up- 
permost column of a predetermined sized block of an input inter frame, respectively. In this case, DCT or DWT is 
performed on the first and second pixels of the leftmost column downward, and performed on the first and second 
pixels of the uppermost row from the left to the right. The loop quantizing unit 82 quantizes DCT coefficients transformed 
by the loop transforming unit 81. The DCT and quantization of the loop transforming unit 81 and the loop quantizing 

55 unit 82 are the same as the transformer 2 and the quantizer 3 described with reference to Figure 1. However, the 
transformation and quantization of the loop transforming unit 81 and the loop quantizing unit 82 do not need the same 
precision as the transformer 2 and the quantizer 3. This is because values produced by the loop transforming unit 81 
and the loop quantizing unit 82 are used to only detect the occurrence of an edge region, and thus may have lower 
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precision than those obtained by the transformer 2 and the quantizer 3 to encode video data. Accordingly, the loop 
transforming unit 81 and the ioop quantizing unit 82 may lower precision In DCT and quantization by using integral 
operation instead of decimal operation , increasing the size of quantization step, or performing a fast-mode DCT, thereby 
reducing the amount of calculation. For instance, an example of a simplified quantization algorithm performed by the 
5 loop quantizing unit 82 is as follows: 

LEVEL = (K X A{QP) + f X 2 20 )/2 20 , 

10 wherein LEVEL denotes a quantized value, K denotes a quantized pixel value on which DCT is performed, A 

(QP) denotes a constant from a mapping table, and f is a constant determined depending on a target compression 
efficiency. The quantized value is set to 1 if K<( r 2 20 -fX2 20 ;/^^QPJ, and is set to another predetermined value otherwise. 
[0052] The filter information producing unit 83 checks if the first and second pixels at the leftmost and uppermost 
rows, on which DCT {or DWT) and quantization are performed, have values other than 0. If the DCT {or DWT) or 

15 quantized second pixel value at the leftmost or uppermost row is 0, the filter information producing unit 83 instructs 
the loop transforming unit 81 and the loop quantizing unit 82 to perform DCT (or DWT) on and quantize a next pixel. 
The filter information producing unit 83 receives a value of the next pixel and checks if the value is 0 and repeats the 
aforementioned operation. 

[0053] if the value which is obtained by performing DCT (or DWT) or quantizing the second pixel value at the leftmost 

20 or uppermost row Is a value other than 0, the fitter information producing unit 83 creates filter information based on the 
result. A method for creating filter information is as described in the first embodiment. Next, the filter information pro- 
ducing unit 83 instructs the loop transforming unit 81 and the ioop quantizing unit 82 to stop performing DCT (or DWT) 
and quantizing a pixel value, respectively. In other words, if the value is not 0, DCT (or DWT) and quantization of pixel 
values at the leftmost or uppermost row are terminated (a detailed description thereof will be later described). The filter 

25 characteristics decision unit 74 determines and outputs filter characteristics based on the filter information. The de- 
blocking filter 75 and the deranging filter 76 perform filtering according to the determined filter characteristics. The 
operations of the filter characteristics decision unit 74, the deblocking filter 75, and the deranging filter 76 are the same 
as those of the filter characteristics decision unit 74, the deblocking filter 75, and the deranging filter 76 according to 
the first embodiment. Therefore, their descriptions will be omitted here. 

30 [0054] Figure 9 is a diagram illustrating a method for obtaining filter information extraction data using the filter infor- 
mation producing unit 83 of Figure 6 and creating filter information from the filter information extraction data, according 
to the second embodiment of the present invention. In the filtering method of Figure 9, DCT and quantization are 
performed on a first pixel C, which is indicated with oblique lines in (a), adjacent to a DC component A at the leftmost 
column of a 4x4 pixel block which is a basic unit for filtering in the present invention. Next, it is checked a value obtained 

35 by DCT and quantization, if the value is other than 0, DCT and quantization are terminated and filter information is 
created based on the checking result. If the value is 0, DCT and quantization are performed on a second pixel C, which 
is indicated with oblique lines in (b), to obtain other values. If the other value is other than 0, DCT and quantization are 
terminated and filter information is created on the checking result However, if the other value is 0, DCT and quantization 
are performed on a third pixel C, which is indicated with oblique lines in (c), and then, it is also checked a still other 

*o value obtained by DCT and quantization. Likewise, if the still other value is other than 0, DCT and quantization are 
terminated and filter information is created based on the checking result. If the still other value is 0 and there is no pixel 
at the leftmost column, filter information is created based on the results already obtained. Filter information is obtained 
as described in the method according to the first embodiment of the present invention. 

[0055] Meanwhile, DCT and quantization are performed on a first pixel B, adjacent to the DC component A, at the 
<5 uppermost row of the 4x4 pixel block, indicated with oblique lines in (d). Next, it is checked a value obtained by DCT 
and quantization, ff the value is other than 0, DCT and quantization are terminated and filter information is created 
based on the checking result. If the value is 0, DCT and quantization are performed on a second pixel B, which is 
indicated with oblique lines in (e), and then, it is checked other value obtained by DCT and quantization. If the other 
value is other than 0, DCT and quantization are terminated and filter information is created on the checking result. If 
SO the other value is 0, DCT and quantization are performed on a third pixel, which is indicated with oblique lines in (f), 
and it is checked a still other value. If the still other value is other than 0, DCT and quantization are terminated and 
filter information is created on the checking result. However, if the still another value is 0 and there is no pixel at the 
uppermost row, filter information is created based on the results already obtained. Filter information is created as 
described in the method according to the first embodiment of the present invention. 
55 [0056] Likewise, DCT and quantization are performed on pixels other than A, B, and C of the 4X4 pixel block in a 
block-by-block basis. Next, a value obtained by DCT and quantization is checked to detect the occurrence of ringing 
noise. Thereafter, filter information is created based on criteria for determining the occurrence of ringing noise and the 
occurrence of the ringing noise. A method for creating filter information is the same as that according to the first em- 
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bodiment of the present invention. 

[0057] Figure 10 is a flow chart illustrating a filtering method according to the second embodiment of the present 
invention. Referring to Figure 10, DCT and quantization are performed on a first pixel, adjacent to a DC component, 
at the leftmost column of a 4x4 pixel block, in order to calculate a quantized DCT coefficient, in step 1001 . After step 
5 1001 , the calculated quantized DCT coefficient is checked in step 1002. If the quantized DCT coefficient is 0, DCT and 
quantization are performed on a next pixel in step 1003, and it proceeds to step 1002. 

[0058] However, if the quantized DCT coefficient is a value other than 0 or a related pixel Is the last pixel at the 
leftmost column. DCT and quantization are terminated and niter information is created on the results already obtained, 
in step 1004. That is, when any pixel at the leftmost column has a quantized DCT coefficient other than 0, horizontal 

10 blocking flag {HBF) is set to 1 as filter information. 

[005d] After step 1004, DCT is performed on a first pixel, adjacent to the DC component, at the uppermost row, and 
an obtained DCT coefficient Is quantized to calculate a quantized DCT coefficient, in step 1005. Next, the calculated 
quantized DCT coefficient is checked in step 1006. If the quantized DCT coefficient is 0, DCT and quantization are 
performed on a next pixel in step 1007, and it proceeds to step 1008. 

15 [0060] When the quantized DCT coefficient is a value other than 0 or a related pixel is the last one at the uppermost 
row, DCT and quantization are terminated and filter information is created based on the results already obtained, in 
step 1006. In other words, if any pixel at the uppermost row has a quantized DCT coefficient other than 0, a vertical 
blocking flag (VBF) is set to 1 as filter information. 

[0061] After step 1008, DCT and quantization are performed a pixel, not at the uppermost and leftmost columns, 
20 adjacent to the DC component in step 1009. Next, an obtained quantized DCT coefficient is checked in step 1010. If 
the quantized DCT coefficient is 0, DCT and quantization are performed on a next pixel in step 1011, and it proceeds 
to step 1010. 

[0062] When the quantized DCT coefficient is a value other than 0 or a related pixel is the last one not at the leftmost 
and uppermost rows, DCT and quantization are terminated and filter information is created on results already obtained 
25 in step 1012. That is, if any pixel, not at the leftmost and uppermost rows, has a quantized DCT coefficient other than 
0, a ringing flag (RF) is set to 1 as filter information. 

[0063] After step 1 012, filter characteristics are determined based on the fitter information, and adaptive filtering is 
performed, in step 1013. A method for making the filter characteristics is as described with reference to Figure 7. That 
is, when the HBF is set to 1 , the filter characteristics decision unit 74 of Figure 2 or 8 determines the filter characteristics 

30 such that the deblocking fitter 75 of Figure 2 or 8 performs filtering more strongly in a vertical direction of a pixel block. 
When the VBF is set to 1 , the filter characteristics are determined such that the deblocking filter 75 performs filtering 
more strongly in the vertical direction of a 4x4 pixel block. In case where both the HBF and VBF are set to 1 , the filter 
characteristics decision unit 74 determines and outputs the filter characteristics such that the deblocking filter 75 per- 
forms filtering more strongly in the vertical and horizontal directions of the 4x4 pixel block. If the RF is set to 1 , the 

35 filter characteristics are determined such that the deranging filter 76 of Figure 2 or 8 performs filtering more strongly 
on the 4x4 pixel block. Then, the deblocking filter 75 and the deranging filter 76 perform adaptive filtering according 
to the set filter characteristics. 

[0064] Deblocking filtering is performed in a block-by-black basis, but video data is in fact inputto an encoder, together 
with pixel values at border regions of blocks adjacent to a current block as well as the current block. The input pixel 
values are filtered by the deblocking filter 75 and outputs as changed values. For instance, pixel values 3 through 6 
are changed when pixel values 1 through 4 of the current block and pixel values 5 through 6 of an adjacent block are 
more strongly filtered by the deblocking filter 75. However, if these pixel values are weakly filtered by the deblocking 
filter 75, only the values 4 and 5 are changed. Accordingly, a flag of an adjacent block is compared with that of a current 
block in order to adjust the filter characteristics of the deblocking filter 75. That is, the filter characteristics value of the 

45 deblocking filter 75 is set to a strong value when the flag of the adjacent block is the same as that of the current block 
and is set to a weak value otherwise, thereby obtaining relatively accurate filter characteristics values. 
[0065] Alternatively, the filter information producing unit 73 may compare the flags VBF, HBF, and RF of the adjacent 
blocks with the flags VBF, HBF, and RF of the current block, and create filter information based an the comparison 
result As a result, the created filter information can be expressed with more accurate values than the filter information 

so consisting of flags of the current block. In this case, filter characteristics values can be more precisely determined. 
[0066] In the filtering method of Figure 10 according to the second embodiment, DCT and quantization are first 
performed on a plurality of pixels, except for the DC component, at the leftmost column of a pixel block; a plurality of 
pixels, except for the DC component, at the uppermost row; and a pixel, not at the uppermost and leftmost columns, 
adjacent to the DC component. However, alternatively, DCT and quantization may first be performed on one of the 

55 above pluralities of pixels. 

[0067] In comparison with the method according to the first embodiment, DCT and quantization are performed in 
units of pixels in the method according to the second embodiment, thereby reducing the amount of calculation. Also, 
DWT, instead of DCT, may be performed on pixels in the method according to the second embodiment, as like in the 
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method according to the first embodiment. 

[0068] Meanwhile, a loop filter of an encoder is used in performing the filtering method In the first and second em- 
bodiments. However, the filtering method may be implemented as a post filter in a decoder. 
[0069] An example of a source code representing a preferred filtering method according to the present invention is 
s as follows: 
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ln£o(0] « WEAK; 

if { (RF of current block 0) && (RP of left block 0) ) { 
if { HBP of current block « 1 ) lnfo[0] = STRONG; 
else lnfo[0) * WEAK; 

if( HBF of left block — 1 ) Info [1] = STRONG; 
else Info[l] - WEAK; 

if< HBF Of left block «= 1 ) infotl] = STRONG; 
else lnfo[l] = WEAK; 

} 



Let PtrIraage[0] be the left-top pixel of current 4x4 block and width 
be the picture width. 

if" (InfoCO] STRONG && Info[l] STRONG) { 
for(m*0; m<4; m++) { 

o[0]«Ptrlmg[-4] ; o [1] =PtrImg [-3 J ; o [2] =PtrImg [-2] ; o [3] -Ptrlmg [-1] ; 
o[4]=Ptrlmg[0] ; o [S] -Ptrlrag [1] ; o [6] =PtrIrag[2] ? o [7} =PtrImg [3] ; 

PtrImgt-2] = (O [0] +2*0 [1] +2*o [2] +2*0 [33 +0 [4] +4) /8; 
Ptrlmg[-1] - (o [1] +2*o[2] +2*o [33 +2*o [4] +o [5] +4) /8; 
PtrlniglO] = (o [2] +2*0 [3] +2*o [4] +2*o [5] +o [6] +4) /8 ; 
Ptrlmgtl] = (o[35+2*o[4]+2*o[S]+2*o[6j +o[7]+4)/8; 



[0070] According to the above source code, it is possible to check if an edge region is present in a block and more 
precisely detect the presence of an edge region In a block by a comparison of filter Information between adjacent blocks. 
[0071] In the filtering method and apparatus described above, blacking artifacts and/or ringing noise can be removed 
by more effectively detecting an edge region. 

[0072] While the present invention has been particularly shown and described with reference to preferred embodi- 
ments thereof, it will be understood by those skilled in the art that various changes in form and details may be made 
therein without departing from the scope of the invention as defined by the appended claims. 
[0073] Attention is directed to all papers and documents which are filed concurrently with or previous to this speci- 
fication in connection with this application and which are open to public inspection with this specification, and the 
contents of all such papers and documents are incorporated herein by reference. 

[0074] All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), 
and/or all of the steps of any method or process so disclosed, may be combined in any combination, except combina- 
tions where at least some of such features and/or steps are mutually exclusive. 
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[0075] Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may 
be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise. 
Thus, unless expressly stated otherwise, each feature disclosed is one example only of a generic series of equivalent 
or similar features. 

s [0076] The invention is not restricted to the details of the foregoing embodiments). The invention extends to any 
novel one, or any novel combination, of the features disclosed in this specification (including any accompanying claims, 
abstract and drawings), or to any novel one, or any novel combination, of the steps of any method or process so 
disclosed. 

10 

Claims 

1. A filtering method for removing blocking artifacts, comprising: 

15 (a) transforming video data in a block-by-block basis; and 

(b) detecting the presence of an edge region in the video data by checking the distribution of values objained 
by the transtbrmation. 

20 2. A filtering method for removing blocking artifacts, comprising: 

(a) transforming and quantizing video data in a block-by-block basis; 

(b) creating filter information based on the distribution of values obtained by the transformation and quantiza- 
25 tion; and 

(c) filtering the video data based on the filter information. 
3. The filtering method of claim 1 or 2, wherein (a) comprises: 

30 

(a1) performing DCT the video data in a block-by-block basis to obtain DCT coefficients; and 

(a2) quantizing the DCT coefficients. 

35 4. The filtering method of claim 1, 2 or 3, wherein (a) comprises performing DCT and quantization on a 4x4 pixel 
block to obtain a 4x4 quantized DCT block. 

5. The filtering method of any preceding claim, wherein (b) comprises creating filter information indicating the degree 
of the occurrence of blocking artifacts and/or ringing noise based on the quantized DCT coefficients. 

40 

8. The filtering method of any preceding claim, wherein (b) comprises (b1 ) creating filter information by checking the 
values of pixels, except for a DC component, at the uppermost row of the quantized DCT block, where the filter 
information indicates whether an edge region is present in a vertical direction of the original pixel block. 

45 7. The filtering method of any preceding claim, wherein (b) comprises (b2) creating filter information by checking the 
values of pixels, except for the DC component, at the leftmost column of the quantized DCT block, where the filter 
information indicates whether an edge region is present in a horizontal direction of the original pixel block. 

B. The filtering method of any preceding claim, wherein (b) comprises (b3) creating filter information by checking the 
so values of pixels not at the uppermost row and leftmost column of the quantized DCT block, where the filter infor- 
mation indicates whether an edge region is present in a diagonal direction of the original pixel block. 

9. The filtering method of any preceding claim, wherein (b) creating filter information by checking the values of a DC 
component A, a pixel B. adjacent to the DC component A, at the uppermost row, and a pixel C, adjacent to the 

55 DC component, at the leftmost column of the quantized DCT block. 

10. Thefiltering method of claim 9, wherein (b) comprises setting a vertical blocking flag (VBF) and a horizontal blocking 
flag (HBF) to 1 as the filter information when only the pixel A has a value other than 0. 
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11. The filtering method of claim 10, wherein (c) comprises deblocking filtering more strongly In the vertical and hori- 
zontal directions of the pixel block if the HBF and VBF are set to 1 . 

12. The filtering method of claim 9, 10 or 11, wherein (b) comprises setting the VBF to 1 as the filter information when 
only the pixels A and B have values other than 0. 

13. The filtering method of claim 12, wherein (c) comprises deblocking filtering more strongly In the vertical direction 
of the pixel block when the VBF is set to 1 . 

14. The filtering method of any of claims 9 to 13, wherein (b) comprises setting the HBF to 1 as the filter information 
when only the pixels A and C have values other than 0. 

15. The filtering method of claim 14, wherein (c) comprises deblocking filtering more strongly in the horizontal direction 
of the pixel block when the HBF is set to 1 . 

16. The filtering method of any of claims 9 to 15, wherein a ringing flag (RF) is set to 1 when the pixels A, B, and C 
have values other than 0. 

17. The filtering method of claim 16, wherein (c) comprises derlnglng filtering more strongly when the RF is set to 1 . 

18. A filtering method far removing blocking artifacts, comprising: 

(a) transforming and quantizing a block consisting of video data in pixel units so as to obtain quantized values, 
checking the obtained quantized values, and creating filter Information when the checking result is for filter 
information; and 

(b) performing filtering based on the created filter information. 

The filtering method of claim 18, wherein (a) comprises: 

(a1) performing DCT and quantization on one of pixels, except for a pixel corresponding to a DC component, 
at the uppermost and leftmost columns of the block to obtain a quantized DCT coefficient; and 
(a2) checking the quantized DCT coefficient, creating filter information based on the checking result when the 
quantized DCT coefficient is a value other than 0, and terminating performing DCT and quantization on the 
pixels at the uppermost row and leftmost column. 

20. The filtering method of claim 19, wherein (a) comprises: 

(a3) checking the quantized DCT coefficient, and performing DCT and quantization on one of pixels, except 
*> for the pixel corresponding to the DC component, at the uppermost row and leftmost column when the quan- 

tized DCT coefficient is 0; 

(a4) repeatedly performing (a2) and (a3) on the remaining pixels, except for the pixel corresponding to the DC 
component and the one pixel, at the uppermost and leftmost columns so as to obtain quantized DC1 4 coeffV 
« cients; and 

<a5) creating filter information when the quantized DCT coefficients for all of the pixels at the uppermost row 
and leftmost column are 0. 

so 21. An encoder for encoding video data, comprising a loop filter wherein the loop filter comprises: 

a filter information producing unit (73) which creates filter Information based on the distribution of values ob- 
tained by transforming and quantizing a pixel block; 

55 a filter characteristics decision unit (74) which determines filter characteristics based on the created filter in- 

formation; and 

a deblocking filter (75) which deblocking filters based on the determined filter characteristics. 
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22. The encoder of claim 21 , wherein the loop filter further comprises: 

a loop transforming unit (71) which transforms pixel values for Inter frame in a block-by-block basis; and 
5 a loop quantizing unit (72) which quantizes values transformed by the loop transforming unit. 
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